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The Homework carries 120 points but the maximum you can score is 100 points. 


(1) Let Y = X 2 + e, where X is uniformly distributed on (0,27r) and e ~ iV(0,cr 2 ) independent 
of X. We think of X as the predictor and Y as the response. 

(i) What is the best predictor of Y in terms of XI (Note that in reality the best predictor is 
typically unknown and needs to be modeled.) 

(ii) Explicitly calculate the best linear predictor of Y in terms of X. 

(iii) Plot the best predictor and the best linear predictor in the same diagram. 

(iv) How would you estimate the best linear predictor based on data (X 2 , Yf),i = 1, 2,..., n 
from the model? (5+5+5+5 = 20 points). 

(2) Problems 17, 19, 48 from Chapter 3 and Problems 49, 61 from Chapter 4. (50 points) 

(3) (i) Let (U, V) be distributed jointly with a spherically symmetric density. In other words, 
let their joint density f(u,v) = Cg(u 2 + v 2 ) , for some non-negative function g. Show that 
(e±U, e 2 V) has the same distribution as (U,V), where ei and €2 are either 1 or -1. Deduce 
that U and V are uncorrelated. (10 points) 

(ii) Now consider i.i.d. random variables {W \, W 2 ) that are independent of (U,V) in 
(a), where each W 2 assumes the value 1 or -1 with probability 0.5. Let Z\ = W\U and 
Z -2 = W 2 V. Show that ( Z\,Z 2 ) again has the same distribution as (U,V). What if W\ and 
W 2 still assume the values 1 or -1, are still independent of (U,V) but the joint distribution 
of the vector (W\,W 2 ) is arbitrary i.e. W\ and W 2 are not required to be i.i.d.? (10 points) 


Consider transforming (U,V) above to (W\,W 2 ) where 

W\ = and W 2 = 


dU-cV 
\Zc 2 +d ' 2 ' 


Here c and d are any two numbers. 


(iii) Show that {W \, W 2 ) T = P(U, V) T for a 2 x 2 matrix P that is orthogonal, i.e. 
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P T P = I. Also show that U 2 + V 2 = W 2 + W 2 . (0 points) 

(iv) Show that (U, V) and {W\, W 2 ) have the same joint distribution. (10 points) 

(v) Let (U. V) be expressed in terms of polar coordinates (R, 0). Thus, U = R cos© and 
V = R sin@. Compute the joint and marginal distributions of (R, 0). Are they 
independent? (10 points) 

(4) Let Y have a density which is symmetric about 0 and let X = SY where S is 
independent of Y and assumes values 1 and —1 with probability 1/2. Show that 
Co v(X,Y) = 0 but that X and Y are not independent. (This shows that uncorrelatedness 
does not necesarily imply independence.) (10 points) 
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